Maximum-likelihood estimation for hidden Markov models
نویسنده
چکیده
Hidden Markov models assume a sequence of random variables to be conditionally independent given a sequence of state variables which forms a Markov chain. Maximum-likelihood estimation for these models can be performed using the EM algorithm. In this paper the consistency of a sequence of maximum-likelihood estimators is proved. Also, the conclusion of the Shannon-McMillan-Breiman theorem on entropy convergence is established for hidden Markov models.
منابع مشابه
Parameter Estimation for Hidden Markov Models with Intractable Likelihoods
Approximate Bayesian computation (ABC) is a popular technique for approximating likelihoods and is often used in parameter estimation when the likelihood functions are analytically intractable. Although the use of ABC is widespread in many fields, there has been little investigation of the theoretical properties of the resulting estimators. In this paper we give a theoretical analysis of the as...
متن کاملEstimation of Hidden Markov Models with Nonparametric Simulated Maximum Likelihood
We propose a nonparametric simulated maximum likelihood estimation (NPSMLE) with built-in nonlinear ltering. By recursively approximating the unknown conditional densities, our method enables a maximum likelihood estimation of general dynamic models with latent variables including time-inhomogeneous and non-stationary processes. We establish the asymptotic properties of the NPSMLEs for hidden...
متن کاملOn Bahadur Efficiency of the Maximum Likelihood Estimator in Hidden Markov Models
In this paper, we study large deviations of maximum likelihood and related estimators for hidden Markov models. A hidden Markov model consists of parameterized Markov chains in a Markovian random environment, with the underlying environmental Markov chain viewed as missing data. A difficulty with parameter estimation in this model is the non-additivity of the log-likelihood function. Based on a...
متن کاملComputation of Restricted Maximum-penalized-likelihood Estimates in Hidden Markov Models
The maximum-penalized-likelihood estimation for hidden Markov models with general observation densities is described. All statistical inference, including the model estimation, testing, and selection, is based on the restricted optimization of the penalized likelihood function with respect to the chosen model family. The method is used in an economic application, where stock market index return...
متن کاملStochastic volatility in mean models with heavy-tailed distributions: A maximum likelihood approach using structured hidden Markov models
In this article, we introduce a likelihood-based estimation method for the stochastic volatility in mean (SVM) model with scale mixtures of normal (SMN) distributions (Abanto-Valle et al., 2012). Our estimation method is based on the fact that the powerful hidden Markov model (HMM) machinery can be applied in order to evaluate an arbitrarily accurate approximation of the likelihood of an SVM mo...
متن کامل